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<57) Abstract 



( A CCTV surveillance system is provided 

• with .in optical device (60) for providing different 
; inuges through different areas of the CCTV cam- 
I era lens (14) controllably at different times. The 
J Jiftncnt images can be used to improve the res- 
j olution of the images obtained, or to increase the 
held of view, by sacrificing the image refresh rate. 
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OPTICAL DETECTION SYSTEM 

This invention relates to an optica, detection system, for example for use in a 
surveillance system. 

5 

Conventional surveillance systems use closed circuit television (CCTV) 
cameras, monitors and video recorders, which use the same standards (PAL 
SECAM. NTSC. etc.) as are used in broadcast television applications. Because of" 
the use of this well-developed technology, CCTV surveillance systems can be highly 
10 cost-effective. Acceptable frame refresh rates and image resolution can be 
ach,eved. without excessive signal bandwidth demands, at a reasonable cost. 

It is desirable, however, in surveillance applications, to achieve the greatest 
possible image resolution, as this may be necessary, for examp.e to be able to 
1 5 identify an individual under surveillance. 

Conventionally, this can only be achieved using a single fixed camera by 
proving a zoom image, which necessarily means thai me field of view of me 
camera ,s restricfed. with obvious disadvantages. Therefore, alternative prior art 
20 systems include multiple fixed cameras, which obviously increase the cos. and 
wetgh. of me system, and mechanically driven single cameras. However these 
latter systems are also cons,de,ab,y more expensive man using a fixed camera 
while m having the disadvantage mat. since they need to be reiatively slow moving' 
pans of the reared Md of view are acteally no, under surveiHance for relatively' 
25 long penods of lime, for example many seconds. 

UK Patent Application No. GB 2 090 100 A describes an optica, imaging 
system in which a liquid oysta, spatial tight modulator is used ,o image sub-areas o, 
a total mage wim me sub-areas being transmitted one by one to a detector, thereby 
30 apparency increasing the spatial resolutton. The system described therein requires 
a respecav. opto, channel for each sub-area. wim each channel having individual 
opbca. components to generate an image of each sub-area on the detector The 
system wou,d therefore be costly to manufacture. ,„ addition, in order to 
accommodate the required optica, components a periscope anangement is required 
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for each optical channel. Whilst such an arrangement might be achievable for a 
relatively low number of optical channels, for example four, it would become overly 
complex if the number of channels were to be increased. 

5 European Patent Application No. EP 0 029 568 A describes an imaging 

system where a liquid crystal spatial light modulator is used to select a sub-area to 
be imaged on a detector. The system described therein incorporates a simple lens 
having the spatial light modulator at its image plane and a compound lens which 
focuses images formed at each of four spatial light modulator elements onto the 
10 detector The spatial light modulator is positioned at the image plane of the simple 
.ens and at the focal plane of the compound lens. In order for the described system 
to work, it would appear that the spatial light modulator has to include some form of 
light scatterer. Such an arrangement is not optically efficient since light would be 
scattered in directions other than those towards the compound lens. 

The present invention derives from the realisation that the relatively high 
frame refresh rate, provided by a conventional CCTV camera so that realistic moving 
images of broadcast quality can be achieved, is unnecessary for most surve.llance 
applications. In such applications, it may be acceptable to sacrifice the high frame 
refresh rate to achieve higher image resolution and/or a wider field of view. In 
accordance with preferred embodiments of the invention, this is achieved by the use 
of an optical device which provides multiple images sequentially to the camera. 

The present invention provides an optical detection system comprising: 
25 (i) an image detector having an image detector area; 

(ii) a lens arrangement for focusing light from a scene onto said detector, and 

(iii) an optical device for acting upon light passing to said detector, 
characterized in that. 

(a) said lens arrangement comprises a lens having a single optical axis; and 

(b) said optical device comprises an array of optical elements each for acting 
upon light passing through a respective portion of said lens wherein said 
optical elements form a plurality of optical channels for the transmission of 
respective images to said detector through said lens; and wherein each 
image substantially fills the whole of the image detector area. 
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The system of me invention may further compose a selective shuder device 
or control ,he transmission o, «, to said detector, said shutter rteZ 
compns.ng an array of shutter etements and a controller for condo„„g said an. of 
shuder elements, eaoh o, said shutter eiements being selectively openabTa n d 

said opbca, elements and sa W respecbve shutter eiements in combinabon ^ 

iens 3 and T' ** °' *° - —~ 

lens, and wheretn said shuder device provides means for selecting a, .east one of 

The selective shuder device may he a spatia, ,igh, modulator which ,„ a 
prefened emhodimen, is a liguid c^sta, spada, light modulator. /^possible 

.s Ley that mechantca, devices would have fewer shuder elements man a liouid 
5 oysta, anay. Pre , erab)y . the ^ ^ ^ ^ ^ ^ 

The system of the invent, may be ananged ,0 selecbvely detect ,mages 
dtrecbon. To achteve ,h,s multi-directiona, capabiidy. the optical device may be an 

bu, ,0 d«ecr V6 ' y ' SyS ' em ^ 66 C ° nfi9Ured '° ^ 3 **• -* action 
bu, .0 detect ,mages over a range of ,00a, distances. Such systems have 

aprons ,n situations where the direcbon in which an object wtn appe^ JZ 
si a 77" ^ ~ SyS ' em ~ ^ * ~ Convenb n^ 

ai: 1 r d requ,re ^ use * — * — - - 

camera w,m a sufftcen. depth of focus ,0 accommodate such unoertainbes a, the 
expense of image resolution. To achieve the van,*,. , , Uncerta,nnes at ,he 
„„,,„, ^ acnieve the vanable focal range capability the 
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The system of the invention may be configured to provide spectral sensitivity. 
This capability may be achieved by a system in which the optica, device is an array 
of filters, each filter having a respective transmission bandwidth. 

For a better understanding of the present invention, and to show how it may 
be put in effect, reference will now be made, by way of example, to the 
accompanying drawings, in which:- 

Figure 1 is a block schematic diagram of a system in accordance with the 
invention; 

Figure 2 is a plan view of a liquid crystal array in the system of Figure 1; 
Figure 3 is a cross-sectional view through the liquid crystal array; 
Figure 4 is a representation of the liquid crystal array in the fully open state, 
Figure 5 is a representation showing an operational sequence of the liquid 
crystal array; 

Figure 6 shows an optical device forming part of a system in accordance with 
preferred embodiments of the invention; 

Figure 7 is an illustration of the use of the system in accordance with the 
invention; 

Figure 8 is an illustration of an optical system in accordance with the 
invention for detecting images at differing focal ranges; and 
Figure 9 is an illustration of an optical system in accordance with the 
invention having spectral sensitivity. 

Figure 1 is a block schematic diagram of a system in accordance with the 
invention. The system includes a CCTV camera 12 and a zoom lens 14. which may 
be of a conventions form. The camera 12 and zoom .ens 14 are positioned such 
that they view a scene through an optical device (not shown in Figure 1). A hquid 
crysta. array 16 is phys,ca..y .ocated between the camera 12 and the optica, dev.ce. 

In this illustrated embodiment of the invention, the liquid crystal array is a 
matrix of nine elements, arranged in a 3x3 square. The array is positioned such that 
the nine elements occupy the whole field of view of the .ens 14. Signals are sent to 
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Ihe array ie from a multipfcxer 18 . which controls which of the dements are ,o be 
opaque, and which are (o be transparent. 

An oscillator 20 provides a signal at. for exampie. ,*Hz through a pair of 
S amp„„ers 22. 2*. which respectively pravide ^Ovol, and ^vol, signal 71 
multiplexer „. These s,gna, ,eve,s are respecdvely those required Tl ^ 
crystal segments off. i.e. opaque, and on. i.e. transparent. 

The muitipiexer 18 is controlled by a digital control dev.ce 26, which sends 

10 output signals to the multiplexer 18 . to contra, the signets which are sen, to 2 ^ 

ctysta, atray ,6. The digita, control device 26 receives signals tram a sync £. 

factor 26. which is connected to the camera 12. On the bas,s o, the signals ^ 
he syn C , , sxUaaor 28 , he digjta| ^ devjce ^ abie 

switch.ng o, the elements in ,he .iquid oysta, atray ,6 remeins synchronous with the 
15 v,deo stgnal. Thus, different elements can be switched on or off during the bTan K l 
penod a, the star, of each frame. The sync s,gna, extractor 26 also "^s a 

rail; S ' 9na '- ^ ^ 6XamP,e be ~ * 3 — ~ or video 

20 Two switches 30. 32 are also connected to the digital control devfce 26 The 

firs, sw„ch 30 defines whether the dig*a, contra, device 26 is in a manual mode 
or an au,oma„c mode. When switch 30 indicates that me contra, is in a manua, 
mode he switch 32 can be used to se, a partner e,emen, o, the liquid c^ 
array 16 which is to be swttched permanentty on. When switch 30 indicals thaTle 
25 con«ro, device 26 is to be in automate mode, the switch 32 can be usTtote the 
rate a, which elements in the „,u,d cvs*, anay ,6 are sequentially switched Z 2 

1 ,T * m ' 9h ' 66 m ° S * USe,U ' '° a » « me video 

frame rate, bu, ,n some situations me rate might be changed, or only M me 

elements might be used, or the elements might be opined ,n gL J to £ 
30 superimposed images. 9 



Figure 2 ,s a plan vtew of the ,iquid crys,a. anay ,6. and Figure 3 is a cross 
elements 40.1. 40.2. .. 40.9. arranged in a 3x3 square. Each liquid c^sta, element 
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40 1 40 2 40.9. is connected to a respective contact pad 42.1. 42.2. .. 42.9. and it 
•s to'these'contact pads tha, the con.ro, signa.s from the muUiplexer 18 are applied 
to turn the elements on or off as desired. 

As shown in Figure 3, the respective liquid oystal elements 40 am in contact 
with a transparent conducing oxide 44. sandwtcned between respective glass plates 
46. 48 as is conventional in the field of liquid crystal dev,ces. 

Faum 4 is a representation of the liquid crystal array in the fully open state, 
while Figure 5 is a reprosentafion showing a sequence in which firs, element 40.1 . 
Con* open liquid ays*, element, men element 40.2 is the only open etement. 
Z so on unfi. element 40.9 is the only open element. The liquid crystal anay thus 
acts as a controllable selective shutter 

„ will be appreciated that the liquid crystal array may be replaced as the 
' shutter by a mechanical shutter, a definable mirror device, or another elec^-opbc 
Jim , is however, advantageous I, the shufier is contro»ab,e a, h„h speed, for 
Tx" Pie such fhe, dmeren, areas o, the shutter can be opened and closed a, a - 
^ corresponds ,o video frame rates. The liquid oysta, array has ft. advantage. 
0 and allows rapid switching to be achieved without causing vibration. 

A s mentioned above, the liquid crystal array 16 is placed in front o, me zoom 
.ens ,4 such ma, it occup.es subs«anfia,l, me whole o, «s field o. view. Posiaoned 
^hin ma, field of view is a further optica, device, wttich consols me images wt„ch 
25 iTsem ,o me zoom lens 14 Ffcure 6 shows an optical device 60. which may be 
us ed,oprovidemu^»nages,omecamera1, Specifically, the opb« 
m mis case has a face which is made up o, nine mirrored surfaces *2X ^ 
62 9 all of which are diffemntly inclined relative to one another, and whtch 
cor^ld in position ,o me elements 40.1. 40.2. .. 40.9 o, the liquid array 
30 7. Z. mtrrol device 60 can men be placed adiacen, ,o me 

-* r-> -l r> 62 9 reflects a different image 
16 such that each of the surfaces 62.1, 62.2.... 62.9. rene 

2Z me corresponding one o, me elements 40.1. 40.2.... 40.9. The and 
,ne shutter apertures must be aligned in accordance wi,h norma, geometnc opfics 
pi ice. Thus, by centreing ,he liquid crysU, array sucb ,ha, only one of me 
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dements is on. i.e. ^nsparem. i, is only me image ref.ec.ed from me conespondino 

m, TOre surface ^ „ _ mrou9h ^ , ens i4 to m(njmj 

mage from one o, me other mitrored surfaces through the open e,em«m, 

« a rrr; ,o: min " ,,ise me pam ,en9,h be,ween ~ ^ - - ~ 

5 a thin black line or dead zone between Dixe!* in #k- . - ^ 

lWBen pixels m (he liquid crystal arrau- „ 

provide a thin biacK „ne or dead zone between me minored sorfacls 

By appropriate design or advent of the device 60. a range of diHeren. 
views can be .ransmined ,o the camera. ,n this i,, u s,ra,ed embodiment. m^Tre 

10 ^ views . „ each liquia ^ eiemem js aaareMed • 

me norma, vdeo frame rare of 2 5H, me video ou,pu. signs, composes a 
of frames made up from images reflected from the nine surfaces. 

15 differ r dSV,Ce ^ ^ bV "» ° P,iCa ' ae " tes provides 

15 dtfteren, ,mages to different pans of me ,i q uid crysta, airay ,6. For exampte instead 

of multiple mirrored surfaces a om„r,^», . cor example, instead 

sunaces. a group of refractive components such as prisms m» 

be used to provide images from different directions. * 

lmp,ementa«on of me system described above makes use of the 
20 ^damenta, properfy of a -perfect ,ens-. name,y ma, a „ image is formed b 

en-enng any sma,, par, of me aperfure of me ,e„s. ,„ practice, using a roa, ,ens 
fbero may be pania, obscuration o, images obtained through on,y pan o, mi Ins 
penure. Hoover, this effect can be reduced to zero by se.ec.ng an a propyl 
standard *» — • a suitabiy high input aperfure A ,mough a standard "! 

puis T * deS ' raBte '° ^ * ~** - ^ h 

puroose Since such a ,ens is on,y deigned for imaging over sma„ patches o i 

surface. .. needs on,y to be optically conected over each sma,, sub^perfu e rale 
than over me entire iens surface. This can reduce the cos, of manufacle. 

► in effect, the camera is receiving a sequence of ( 

cbannels By con,ras, wlth a convent, sysl.Talg ZZZ 
sys,em in accordance wHh me invention can provide a dm! J/ 
•brougn each o f ,he nine channe,, covehng me s^ Z ~ TZ 
conven„ona, system, such that, in any one channel, me image is ZZ ^ 
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r.r^r — rrrr .-j rrs. 

effect, by sacnficing me frame refresh rate. Theim 9 

oniw at 1/9 of me \rideo rate, that is. once eveiy ^ 
cnannels . upda*d< «, aM* ^ app|icafcns 

r tjh — «*. — « • ■» 

™ m - o, course be ^ by — « me *--P- — - 
Invert video casse«e recede, wifh a freeze frame capably. 

fioure 7 is an illusion of me use of me sysfem in accordance wifr, me 
figure 7 a ^entonally available, wthout 

invent ,o provide wrfer « * » , 2 ^ lens 14 . charge 

sacnficing .mage resolution. Figure 7 snow 

. how*, (CCD) 72 liquid crystal array 16. and optica, device ou. 

coupled device (ecu) '-s. »m camera receives an 

■ a - r.rrrr * rr-'n-c- — - - « 

^irr in figure 7b. a second o.ca, e^en, 
st ate. and me camera receives an imege from a «««d« o v 
^ a second mirrored surface 6 2 b of me opec^ «^ " ^ 
0 epical element 40c is in me transparent sWe. and me came* 

- a third field o, vie. 74c = ma ^ = ^ _ 

« course, any convent number o, Channels can be used 

* w,en me firs, op S ca, efemen, 40a is in a franspaten, 

.enne, from me «. - ~ 74a via - firs, — ^ ^ _ 
op «ca. element 40a. though the lens ,4 ,o .he CCD7 is ^ ^ 

me se cond op^ = ^ trr^a^^cnannelfrommemird.eld 

30 field of view 74b to the CCD u. »s ro"'" 

of view 74c when the mird optica, element 40 is fransparen.. 

ln the absence o, me o P .,ca, device « . - -« - ~ 
16 wou»d be to act as a variable aperture control for the lens 
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to the CCD 72 through the different optical elements 40a. 40b. and 40c would be 
substantially identical. Increasing the number of transparent optical elements would 
•ncrease the effective aperture of the lens 14. With the optical device 60 in place 
the lens 14 acts as an integrator for the optica, channe.s. The light ray lines shown 
.n Figure 7 are not intended to portray an accurate representation of the optical 
properties of the components but are a guide to the eye to indicate the genera, 
principles of operation of the system. 



As descnbed above, the system of the present invention can be used to 
10 provide nine separate images, each updated once every 360ms. rather than a single 
-mage updated once every 40ms. The images can be in directions which are 
overlapping, or adjacent, or widely separated, and the optical device 60 can readily 
be designed to achieve the required effect, or can be designed to be easily 
adjustab.e on site. It is also possib.e to insert a second mirror in some channe.s so 
15 that some of the images are in opposite directions to one another. Such a system 
can then be used where any conventions CCTV camera is used, and is particularly 
advantageous where high resolution or a wide field of view is important, particularly 
when the weight of the camera is a consideration. 



20 



25 



One particular advantage is that, by comparison with a conventional system 
in which a camera pans and tilts, to different positions, in this case there is no 
Physrcal movement of the camera, and so images through a particular one of the 
channels always cover exactly the same area. This means that image processing, 
for example motion detection, is much simpler. 



An illustration of the advantage of the present invention can be demonstrated 
w,th reference to an automatic number plate recognition system. In such a system it 
« des,red to obtain an image of a vehicle number p.ate. which has a width of 
approximately 600mm. and which is at an unknown point on a road, which may for 
30 exam P .e have a width of 3600mm. Using a conventional system, the six hundred or 
so horizontal image pixels must be used to obtain an image of the full road width 
wh,ch means that approximately one hundred pixels are available to resolve the 
details of the number plate. This number can be insufficient, in particular if the 
number plate is dirty or damaged. However, using the system in accordance with 
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Ms invenfion. different optical channels could be used to provide images of 
overtopping regions o. me road vridth. For example, each o, the regions ma, be 
900mm wide. With a total of nine overlapping images to choose from, it would be 
certain ma. one of me images would contain an image of me number plate 
5 occupying approximate,, two thirds of me .otal image. Thus, approximate,, four 
hundred of me six hundred or so horizontal pixets woutd be available to reserve ,he 
image. 

Moreover, when me number plates are retroreflective. me image of me 
10 number plate will probabl, be b, far me brightest object in ma field of view. By 
appropriate image processing, n is men possible to open onty me element of me 
to*, cryste, array which contains me image of the number ptate under software or 
hardware control. 

One alternative use of me invention would be as part of an image processor 
such as a photocopier, facsimile machine, or scanner The optica, dev.ee. 
comprising a controllable shutter, and means for transmitting images of afferent 
pans of a document, could be positioned such that images are formed of a 
successron of patches covering a comptete document The partial images can men 
he combined by image processing software to form an image of me comptete 
document, for storage, printing or transmittal as required. 

The optical device described above has nine angled surfaces, which provide 
jma ges of different fields of view However, it wil, be appreciated mat me same 
concept can be applied 10 any optica, system. For example, me optical dev.ee can 
he configured to provide .mages of me same field of v,ew. bu, focusing a. different 
ranges This would have me advantage over a mechanic^ driven optical system 
,ha. me different opto, configurations can be pre-set. and so it is possible to return 
,o one of me configurations without an, of the dela, associated w«h moving 
mechanical parts. Moreover, a much greater depth o, focus could be achievable. 

Referring to Figure 8 mere is shown an optica, de.ec.on s,stem 100 which 
provides for focusing at different ranges. The system 100 comprises an image 
Lector 102. for example a CCD array and a lens 104 for focusing .naden. l.gh. 
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onto the detector 102. A liquid crystal array spatia. light modulator 106 is positioned 
adjacent the lens 104. A compound lens 108 is between a scene (not shown) and 
the SLM 106. The SLM 106 comprises a 9 x 9 array of liquid crystal elements for 
example element 1 10. The compound lens 108 comprises a 9 x 9 array of lenslets 
5 for example lenslet 112. each lens.et having a respective focal length. In operation" 
the individual elements of the SLM 106 are successively made transparent As a 
result of the individual lenslet of the compound lens 108 in front of each SLM 
element having a differing focal length, the successive selection of SLM elements 
has the effect of providing successive images on the detector 102. with each image 
10 hav.ng a different foca, range. The system 100 can therefore scan a scene in front 
of .t at different focal ranges with no moving mechanical parts. 

As an alternative to the use of a compound lens such as the lens 108 a 
vanable foca, range system cou.d comprise a SLM behind a lens with an array' of 
15 blocks of refractive material of differing thicknesses placed against the SLM or the 
lens. 

A potential application for a system which automatically scans a field of view 
over a range of focal distances would be an automatic object recognition system 
20 where it is uncertain what the separat.cn between the system and the object to be 
recognised would be. 



A further amative is that the optical dev,ce can include spectral fillers as 
shown in F ,gure 9. such that the different optica, channels provide different* filter 
2S images. For example. us.ng red. green and blue niters 120. 122 and 124 i, is 
possible .o achieve a colour ,mage. using a monochrome camera. By selecting 
■ntra-red (,R, fitters, i, is also possible ,o obtain a -colour ,R image, or ,o compare 
the total IR with the total visible image. 



30 



A further alternative is that the optica, device may include a number of 
pnsms. which are at different angles to one another, and thus provide differently 
rotated images in the different optica, channels. This may be advantageous in 
snuations where image processing is to be earned out. because ,n some situations it 
« much eas,er to process an image which is correctly rotated. Using an optical 
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device of this type, it is possible to obtain a number of differently rotated images, 
and to select the image which is most easily processed. 
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CLAIMS 

1 An optical detection system comprising: 

(0 an image detector (72) having an image detector area 

00 a »ens arrangement (14) for focusing Hgnt from a scene onto said detector 

<«.) an opto, device (60, for acling upon tight passing ,o said detector 
characterized in that: 

(a) said lens arrangement comprises a tens (14) having a singie opto, axis; 

(b) said optica, device comprises an array of opto, etemenrs (62a 62b 62c) 
each for acting upon tight passing through a respective portion oi said tens 
wherein said opto, e,emen,s form a plurality of optica, channels for the 
transmission of re spec,ive images to said detector through said tens and 
wheretn each image substantia,* fUts the whote of me image detector area. 

An optica, detection system according to Cairn 1 characterized in tha. the 
system further comprises a se,e«ive shutter device (16, for centreing the 
transmission o, ,igh, to said detector, said shutter device comprising an array 
of shutter etements ,40.,. 40.2, and a control (18, 26, tor centring said 
array of shufter e,emems, each of said shutter etements being se,ectivety 
openabte and ciosab,e in response to a respeCve contto, signa, from said 
control and wherein said opto, etements and said respeaive shutter 
etements in combination torn, a p,u«ity of opto, channets for the 
transmission o, tight to sa,d detector through said tens; and wheretn said 
shutter device provides means tor setecting a, teas, one o, said opto, 
channets for me transmission therethmugh o, an image to said detector. 

A system according to Cairn 2. characterized in tha, said setecBve shutter 
device comprises a spatial light modulator 

A system according to Claim 3. characterized in that said spatial light 
modutator comprises a liquid c^ta, spatia, light moduiator and wherein 
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elements of said liquid crystal spatial light modulator are substantially 
transparent in an open state and substantially opaque in a closed state. 



5. 



6. 



A system according to Claims 3 or 4. characterized in that said spatial light 
modulator is positioned adjacent said lens. 

A system according to Claim 5. characterized in that said lens arrangement, 
spatial light modulator and optical device in combination provide selectable 
images to the detector from a plurality of directions. 

7 A system according to Claim 6, characterized in that said optical device 
comprises an array of reflective elements, each element having a respective 
inclination. 



8. 



10. 



11. 



12. 



A system according to Claim 5, characterized in that said lens arrangement, 
spatial light modulator and optical device in combination provide selectable 
images to said detector, said selectable images having differing ranges of 



focus. 



A system according to Claim 8. characterized in that said optical device 
comprises an array of lenslets, each lenslet having a respective focal length. 

A system according to Claim 8. characterized in that said optical device 
comprises an array of optically transmissive elements of differing thickness. 

A system according to Claim 5. characterized in that said lens arrangement, 
spatial light modulator and optical device in combination provide selectable 
images to said detector, said images having differing spectral frequency 
ranges. 

A system according to Claim 11, characterized in that said optical device 
comprises an array of spectral filters, each filter having a respective 
transmission bandwidth. 
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A surveiHance system characterized in that said survei.lance system 
compnses an optical detection system according to Claim 2. 
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